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Abstract. In [LM], we proved a family version of the famous Witten rigidity the- 
orems and several family vanishing theorems for elliptic genera. In this paper, we gere- 
nalize our theorems [LM] in two directions. First we establish a family rigidity theorem 
for the Dirac operator on loop space twisted by general positive energy loop group rep- 
resentations. Second we prove a family rigidity theorem for spm c -manifolds. Several 
vanishing theorems on both cases are also obtained. 

Introduction In [W], Witten considered the indices of elliptic operators on the 
free loop space LM of a manifold M. In particular the index of the formal signature 
operator on loop space is exactly the elliptic genus of Landweber-Stong. Witten made 
the conjecture about the rigidity of these elliptic operators which says that their S 1 - 
equivariant indices on M are independent of g G S 1 . We refer the reader to [T], [BT], 
[H], [K], [L] and [O] for the history of the subject. 

In [Liu2], the first author observed that these rigidity theorems are consequence of 
their modular invariance. This allowed him to give a simple and unified proof of the 
above conjectures of Witten. In [Liu4], it was proved the rigidity of the Dirac operator 
on loop space twisted by positive energy loop group representations of any level, while 
the Witten rigidity theorems are the special cases of level 1. An il- vanishing theorem for 
loop spaces with spin structure, which is an analogue of the famous it-vanishing theorem 
of Atiyah and Hirzebruch [AH], was also proved in [Liu4]. Recently, by using Liu's idea, 
Dessai [Dl] proved a version of rigidity theorem for spm c -manifolds. 

The purpose of our paper is to generalize these results to family case. 

Let M, B be two compact smooth manifolds, and tt : M — > B be a submersion with 
compact fibre X. Let a compact Lie group G act fiberwisely on M, that is the action 
preserves each fiber of tt. Let P be a family of elliptic operators along the fiber X, 
commuting with the action G. Then the family index of P is 

(0.1) Ind(P) = KerP - CokerP G K G (B). 

Note that Ind(P) is a virtual G-representation. Let ch ff (Ind(P)) with g G G be the 
equivariant Chern character of Ind(P) evaluated at g. 

To consider rigidity, we only need to restrict to the case when G = S 1 . ^From now 
on we let G = S 1 . A family elliptic operator P is called rigid on equivariant Chern 
character level with respect to this ^-action, if ch ff (Ind(P)) G H*(B) is independent of 
geS 1 . 

In [LM], several family rigidity and vanishing results for elliptic genera were ob- 
tained. As pointed out in [LM], by taking expansions in H*(B), from the family rigidity 
and vanishing theorems we get many higher level rigidity and vanishing results for char- 
acteristic numbers of the family. These characteristic numbers may not be the indices 
of any elliptic operators. 
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This paper is the continuation of [LM], and is naturally divided into two parts. 
In Section 1, we prove a family rigidity theorem of the Dirac operator on loop space 
twisted by positive energy loop group representations, and we also derive some vanishing 
theorems. In Section 2, we prove the family rigidity and vanishing theorems for spin c - 
manifolds which generalize the results of Dessai [Dl] 
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1 Loop groups and family rigidity theorems 

This Section is organized as follows: In Section 1.1, we recall the modular invariance of 
the characters of the representations of affine Lie algebra. In Section 1.2, we state the 
family rigidity theorems of the Dirac operator on loop space twisted by general positive 
energy loop group representations for spin manifold. In Section 1.3, we prove the main 
theorem, Theorem 1.2. In Section 1.4, we derive some vanishing theorems. 

1.1 Characters of affine Lie algebras 

Let G be a simple, simply connected compact Lie group and LG be its loop group. There 
is a central extension LG of G 

(1.1) 1 ^S 1 ^LG^LG^ 1. 

The circle group S 1 acts on LG by the rotation R e , R e u(9') = v{6' — 9). The action of 
S 1 on LG lifts (essentially uniquely) to an action on LG. We say the representation U 
of LG is symmetric if RqU^R^ 1 = Ur bV . We say a representation E of LG is positive 
energy [PS, Chap 9] if 

(a) E is a direct sum of irreducible representations; 

(b) E is symmetric and E° = (BjeisiEj is dense in E, where Ej = {v G E : Rqv = 
e~ l i v } and Ej is a finite dimensional complex representation of G; 

(c) The action of LG x S 1 on E naturally extends to a smooth action of LG x 
Diff + (S' 1 ), where Diff + (S' 1 ) is the group of orientation preserving diffeomorphisms of S 1 . 

Let g be the Lie algebra of G. Let rj be the Cartan subalgebra, W be the Weyl group 
of g. Denote by Q = E- =1 Zaij, where {c^} is the root basis, the root lattice of g. Then 
the affine Lie algebra associated to g is 

(1.2) L = ® R C[t,r 1 ]©CK©Crf, 

where K (resp. d) is the infinitesimal generator of the central element (resp. the rotation 
of S 1 ) of LG. Lg has the triangle decomposition 

(1-3) Lg = rj_ ®fj®rj + , 

where rj± are the nilpotent subalgebras and rf = rj ®r C © CK © Cd is the Cartan 
subalgebra. Let (, ) be the normalized symmetric invariant bilinear form on Lg which 
extends the standard symmetric bilinear form on g, such that 

(1.4) (CiC©Cd,g® R C[M _1 ])=0; {K,K) = 0; (d, d) = 0; {K,d) = l. 

Let rj* be the dual of rf with respect to (, ). Let (, ) denote the pairing between rj* and 
rj. Then the level of A e rj* is defined to be (A, K). Let A , 6 G rj* be the elements such 
that 5\ v(BC k = 0, (5, d) = 1; A |r,ecd = 0, (A , K) = 1. 

It is known that falls into class in the classification of Kac-Moody algebras 
[Kac, Chap 7]. An L$j-module V is called a highest weight module with the highest 
weight A G rj* if there exists a non-zero vector v G V such that 

(1.5) fj + (v)=0; h(v)=A(h)v, for h E rj; and C/"(£fl)(u) = V. 
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where U(Lg) is the universal envelopping algebra of Lg. An irreducible representation 
L(A) of Lg with the highest weight A is called of level k = (A,K). L(A) is said to be 
integrable if A G P + = {A G rj* : (A, ctj) G N for all i}, the set of dominant integral 
weights. An integrable highest weight representation L(A) of Lg can always be lifted to 
a representation of LG which turns out to be irreducible and of positive energy. 

Since each LG-module V has a weight space decomposition V = (Bx^-Vx, we can 
define formal Kac-Weyl character of U as ch v = E Ae ^* (dim(V\))e A . 

The normalized character of L(A) is xa — Q mA( ^L(A), where [Kac, (12.8.12)] 

_ (A + 2p,A) mdimg 
1 ' mA ~ 2(m + /i v ) 24(m + /i v )' 

where h y = (p, K), the dual Coxeter number, p = p + h v Ao [Kac, (6.2.8)], and p is half 
the sum of the positive roots of g. We call q mK the anomaly factor. 

Let M = Z(W ■ 9) be a lattice in rf, where 9 is the long root in rj, and W is the Weyl 
group of g. For any integer m, let P™ = {A G P+\ (A, A") = m} be the level m subset of 
the dominant integral weights. 

If we choose an orthonormal basis {vj} l j =1 of r/* ® R C, such that for v G rj*, then we 
have 

v = 2iri(Y< l j =1 ZjVj — tA + uS). 

we denote z = T} s=l z s v s G rj* ® R C. Recall the classical theta functions associated to the 
lattice M is defined by 



(1.7) Q x (z,r) = e 2mmu ^ 



e 



■nimr (7 , 7 ) + 2ir im (7 , 2 ) 



7GM+m- 1 A 

Here A means the orthogonal projection of A from rj* to rj* ®r C with respect to the 
bilinear form (•, •), and 7 = T l l i=1 r y i Vi with (7,-2) = E- =1 7iZj. Then we can express xa as 
a finite sum 

(1-8) Xa(z,t)= Yl c a x (t)Q x (z,t), 

AeP m mod(mM+C<5) 

Where P m is the level m element in the integral weight lattice, and {c^(r)} are some 
modular forms of weight which are called string functions in [Kac, §12.7, §13.10]. 

One of the important facts about the formal character is that xa is holomorphic in 
{verj: Re(<5, v) > 0} = {(z, r, u) G C l+2 , Im(r) > 0}. 

Now, we state the following important Kac-Peterson theorem on the modular trans- 
formation property of xa under SL 2 (Z) [Kac, Theorem 13.8]. 

Theorem 1.1 Let A G P™. Then 

(1-9) XA(p ~\) = e™ m{z ' z)/T E S a,a>Xa>(z, r), 

A / e pm modC5 

for some complex numbers S\ t \', and 

(1.10) XA(z,r + l)=e 2mm -XA(z,r). 
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By (1.8), for a G M, we also have 



(1.11) 



X\(z + a,r) = Xa(z,t); 
X A(z + ar,r) = e 2mm ^ c 




Xa(z,t). 



This, together with its transformation formulas (1.9), (1.10), means that xa is an l- 
variable Jacobi form of index m/2 and weight 0. 

1.2 Family rigidity theorem of general elliptic genera 

Let 7r : M — > B be a fibration of compact manifolds with fiber X, and dimX = 2k. We 
assume that the S 1 acts fiberwisely on M, and TX has an ^-equivariant spin structure. 
Let A(TX) = A+(TX) © A~(TX) be the spinor bundle of TX. Let D x be the Dirac 
operator on A(TX) which is defined fiberwisely on the fiber X. 
For a vector bundle F on M, we let 



be the symmetric and respectively the exterior power operations in if(M) [[£]]. 

Assume E is an irreducible positive energy representation of LSpin(2l) and V is 
an S* 1 equivariant vector bundle with structure group Spin(2l) over M. Let A be the 
highest weight of E and m be the level of E. By the discussion in Section 1.1, we have 
the decomposition E = (B n >oE n under the action of Rg. Here E n is a finite dimensional 
representation of Spin(2l). Let P be the frame bundle of V, which is a Spin(2l) principal 
bundle. We define 



Let pi(-)si denote the first S^-equivariant Pontrjagin class. 

Theorem 1.2 For E an irreducible positive energy representation of LSpin(2l) of high- 
est weight of level m, if p 1 (TX) s i = mp 1 (V)si, then the elliptic operator 



is rigid on equivariant Chern character level. 

Theorem 1.2 actually holds for any semi-simple and simply connected Lie group, 
instead of Spin(2l). 



(1.12) 



S t (F) = l + tF + t 2 S 2 F + --- } 
A t (F) = l+tF + t 2 A 2 F + ---, 



(1.13) 



iI>(E, V) = S n > (P x Spi n(2i) E n )q n e K(M)[[q}\. 



D x ®% =1 S qm (TX)®ij(E,V) 



1.3 Proof of Theorem 1.2 



For t G H = {r E C; Imr > 0}, q = e 2wiT , v G C, let 



9 3 (v, r) = c(q)n™ =1 (l + q n ~ 1 / 2 e iiriv )I^ =1 (l + q^^e' 2 ™), 
e 2 (v,r) = c(q)U^ =1 (l - q n - l l 2 e 2 ™)TY% = ^l - q n - l l 2 e- 2 ™), 
0i{v,t) = c(g)g 1 / 8 2cos(7rt;)n^ =1 (l + q n e 2niv )U^ =1 (l + q n e - 2niv ), 
0{v,t) = c(g)g 1 / 8 2sin(7rt;)n^ =1 (l - q n e 27riv )U^ =1 (l - q n e~ 2 ™). 
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be the classical Jacobi theta functions [Ch], where c(q) = n^ =1 (l — q n ). 

Recall that we have the following transformation formulas of theta- functions [Ch]: 

6(t + l,r) = -6(t, r), 6(t + r,r) = -q-W e -™6(t, r), 

1 J fli(t + i,r) = -d^r), e 1 (t + T,T) = <r 1/2 e-™e 1 (t,T). 

and 



- J) = JZe^U*, t), ^(t, r + 1) = e^,^, r), 



(1.16) 

2 (J , - J) = vT^ift r )' r + 1) = S (*, r), 

3 (J, - J) = yfie^esit, r), 9 3 (t, r + 1) = r). 

Let g = e 2mt E S 1 be a topological generator of 5 1 . Let {M a } be the fixed sub mani- 
folds of the circle action. Then 7r : M a — > 5 be a submersion with fibre X Q . We have 
the following S^-equivariant decomposition of TX 

(1.17) TX, Ma = N, © • • • © N h © TX a , 

Here iV 7 is a complex vector bundle such that g acts on it by e 27rm M. We denote the 
Chern roots of iV 7 by 2-nix^, and the Chern roots of TX a © R C by {±2niy'j}. Let 
dim c N y = d(m y ), and dimX Q = 2k a . 
Let 

(1.18) V\ Ma = V 1 ®---®V k , 

be the equivariant decomposition of V restricted to M a . Assume that g acts on V v by 
e 2mn v t^ w here some n v may be zero. We denote the Chern roots of V v by 2itiu{. Let us 
write dim R T4 = 2d(n v ). By [Liu4, §3.5], the equivariant Chern character of ip(E,V) 
can be obtained as q~ mA CE,v(u + t, r), where 

(1.19) C Ey (u + t,T)=XE(U + T,r), 

with U + T = {u\ + n{t, • • • , u\ Q + 7ij i). 

For 5 = e 2 ™*, t G R, and r G H, q = e 27Tir , we let 

oo 

(1.20) F Ey (t, r) = q m *ch g (lnd(D x (g) S^TX - dimX) © V))) . 

m=l 

For f(x) a holomorphic function, we denote by f(y')(TX 9 ) = Ujf(y'j), the symmetric 
polynomial which gives characteristic class of TX 9 , and similarly for iV 7 . Using the family 
Atiyah-Bott-Segal-Singer Lefschetz fixed point formula [LM, Theorem 1.1], (1.14), we 
find for t e [0, 1] \ Q 

Considered as functions of (£, r), we can obviously extend FE t v(t,r) to meromorphic 
functions on C x H with values in H*(B), and holomorphic in r. Theorem 1.2 is 
equivalent to the statement that F E y{t,r) is independent of t. To prove it, we will 
proceed as in [Liu4], [LM]. 
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Lemma 1.1 Ifpi(TX)si =mpi(V)si, then for a, b G 2Z ; 

(1.22) F Ey {t + aT + b,T) = F Ey {t,r). 
Proof: By (1.15), for a,b G 2Z, / G Z, we have 

(1.23) 0(z + Z(t + ar + b), r) = g-^z+^at+^r)^ + ^ T y 
Since rapi(V)si = p 1 (TX) s i, we have 

(1.24) mS BJ (< + n v tf = E^) 2 + E 7j (4 + m 7 t) 2 . 
This implies the equalities: 

(1 .25) mS ^(<) 2 = E i(^) 2 + S 7J -(4) 2 , 

By using (1.11), (1.21), (1.23), and (1.25), we get (1.22). ■ 

Now we will prove that FE,v(t,r) is holomorphic in t. Then, by Lemma 1.1, we get 
the rigidity theorem. 

To prove FE,v(t, r) is holomorphic in t, we will examine the modular transformation 
property of FE,v(t,r) under the group SX 2 (Z). 

Recall that for g = ^ ^ G SX 2 (Z), we define its modular transformation on 

C x H by 

Obviously, the two generators of SL 2 (Z) are ^ = ^ ^ (|)'^ = (o 1 ) ' 
They act on C x H in the following way: 

(1.27) S (t,r) T(t,T) = (t,T + l). 

Let ^f T be the scaling homomorphism from A(T*B) into itself : (3 — > r z dcgl3 f3. If a is 
a differential form on B, we denote by {a}^ the component of degree p of a. 

Lemma 1.2 For any g = ^ ° ^ ^ G SL 2 (Z), we /iawe 
(1-28) F E ,v(g(t, r)) = (cr + d) k V CT+d F gE ,v(t, r), 

where gE = H^a^E^ is a finite complex linear combination of positive energy represen- 
tations of LSpin(2l) of highest weight of level m, and we denote by 

F gE ,v(t, r) = (2ni)- k 9'(0, r) k £ £ a M 7r, [(^r) {TX») 

1 ' J , v (« + t,r) 



n 7 #(:r 7 + m 7 t, r) (iV 7 ) . 

the complex linear combination of the equivariant Chern characters of the corresponding 
index bundles. 
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Proof: Set 

O f (0,r) 



(1.30) F(t,r) 



6{t,r)- 
By (1.16), we get 

(1.31) F(g(t, r)) = (cr + d)e~ cmt ' ''^ CT+d ^ F((cr + d)t, r). 
By Theorem 1.1, (1.19), it is easy to see that on M a: 

(1.32) C E ,v(g(u + t, r)) = e ™™Xvj(ui+n v t) 2 /(cT+d) CgE v ( u + tjT y 
with 

(1.33) CgE,v(u + t,r) = E^a^CE^viu + t,r). 
By using (1.21), (1.31), (1.32), we get 



E,V 



j) = (2m)- k J2^[{^y'F(y',^ d ))(TX^ 



cr + cf cr + d ^ * l V ' cr + d 

a 

„ m^t ar + 6 w , T .\^ . t ar + 5, 

(1.34) 7 V V7 CT + d cr + d' y ") , v cr + rf cr + rf 7 J 
= (cr + d) fe (27u)- fe tt* [(27iVF((cr + r)) (TX^) 

a 

Il 7 ^F((cr + d)x 7 + m 7 t, r)(iV 7 ) jc 9 £ 5 y((cr + <f)-u + £, r) 
By (1.34), to prove (1.28), we only need prove the following equation for p G N, 

{vr* [(2my'F((cT + d)y\ r)) (TX S 

n 7 (F((cr + d)x 7 + m 7 t, r)(A?" 7 ))c gE) y((cr + d)u + t, r)j V 

(1.35) r r/ \ 
= (cr + ^{tt* [(27rVF(y', r)J (TX* ) 

n 7 (^F(a; 7 + m 7 t, r)(Ag)c gE , y (u + t, r)] j^. 



(2p) 



By looking at the degree 2{p + k a ) part, that is the (p + k a )-th homogeneous terms of 
the polynomials in x's, y n s and w's, on both sides, we get (1.35). The proof of Lemma 
1.2 is complete. ■ 

The following lemma is a generalization of [Liu4, Lemma 2.3], 

Lemma 1.3 For any g G SL 2 (Z), the function F g Ey(t,r) is holomorphic in (t,r) for 
(t, r) G R x H. 

Proof. Let z = e 2ntt , and let N = max Q , i7 |m 7 |. Denote by D N C C 2 the domain 
(1.36) (gl 1 ^ < \z\ < \q\-^ N ,0< \q\ < I. 
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By (1.14), (1.19), (1.21) and (1.29), we know that in Dn, F gE y(t,r) has a convergent 
Laurent series expansion of the form 

oo 

(i.37) E^^E&w 

n j=0 

Here {tfJz)} are rational functions of z with possible poles on the unit circle. 
Now considered as a formal power series of q, 
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S qn (TX - dimX) ® ( ]T a^MEp, V)) = ^ a^V (g) ^ 

n=l /i |U j=0 

with G Ksi(M). Note that the terms in the above two sums correspond to each 
other. Now, we apply the family Lefschetz fixed point formula [LM, Theorem 1.1] to 
each V? , for t G R \ Q, we get 

(1.38) ^(^) = ch 2 (Ind( J D®\/g). 
But by [S, Proposition 2.2], we know that 

(1.39) K s i(B) -K(B)®R(S 1 ) 
This implies that for t G R \ Q, z = e 2wit , 

(1-40) W = s£%agV. 

for N(j) some positive integer depending on j and afj" G H*(B). Since both sides are 
analytic functions of z, this equality holds for any z G C. 

On the other hand, by multiplying F gE y(t,r) by f(z) = n Q7 (l — z m ~ty d ( m ~t) ([' — 
dimM), we get holomorphic functions which have a convergent power series expansion of 
the form E M a M g m VE^ c? (z)^, with {c? (z)} polynomial functions in D N . Comparing 
the above two expansions, one gets 

(1-41) dj^z) = f(z)bl(z) 

for each j. So by the Weierstrass preparation theorem, we get F gE y(t, r) is holomorphic 
in Dn. ■ 

Proof of Theorem 1.1: We will prove that F E y is holomorphic on C x H, which 
implies the rigidity theorem we want to prove. 

/From their expressions, we know the possible polar divisors of F E y in C x H are of 
the form t = f(cr + d) with n, c, d, I intergers and (c, d) — 1 or c = 1 and d = 0. 

We can always find intergers a, b such that ad — be = 1, and consider the matrix 

g= ( d "M eSL 2 (Z). By (1.28), 



-c a 



(1-42) * { - CT+ a)F 9E ,v(t, r) = (-cr + a)- k F Ey (—^—, -^^-) 

V— ct + a —CT + a/ 
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Now, if t = j(cr + d) is a polar divisor of FE t v(t,r), then one polar divisor of 
F gE ,v(t,r) is given by 

/- „„\ t n / dr — b \ 
(1.43) = -c + d), 

which exactly gives t = n/l. This contradicts Lemma 1.3, and completes the proof of 
Theorem 1.1. ■ 

1.4 Family vanishing theorems 

Recall that a (meromorphic) Jacobi form of index n and weight / over L x T, where L is an 
integral lattice in the complex plane C preserved by the modular subgroup T C SX 2 (Z), 
is a (meromorphic) function F(t, r) on C x H such that 

' " T ' b ) = (cr + d) l e 2mn ^^ +d ^F(t,T), 



1.44) y cT + d'cr + d 

F(t + At + fi, t) = e -^M* 2 T+2Xt) F ^ r); 



where (A, /i) G L, and p = ^ ° ^ ^ G T. If F is holomorphic on C x H, we say that F 

is a holomorphic Jacobi form. 
For iV G N*, set 

(1.45) r(7V) = ^G5L 2 (Z)|^(J j)(modiV)}. 

Recall that the equivariant cohomology group Hg l (M, Z) of M is defined by 

(1.46) Hgi(M, Z) = H*(M x s i ES 1 , Z). 

where i^S* 1 is the usual S^-principal bundle over the classifying space BS 1 of S 1 . So 
if*! (M, Z) is a module over if* (BS 1 , Z) induced by the projection W : Mx s i ES 1 ^ BS 1 . 
Let pi(V) s i,Pi(TX) s i G H*j_(M, Z) be the equivariant first Pontrjagin classes of V and 
TX respectively. Also recall that 

(1.47) H*(BS\Z) = Z[[u}} 

with u a generator of degree 2. 

In this part, we suppose that there exists n G Z such that 

(1.48) mpi(y) 5 i =n-7fV in H* s i(M, Z) <g> z Q. 
As in [Liu4] , we call n the anomaly to rigidity. 

Theorem 1.3 Let M,B,V and E be as in Theorem 1.2. Then for p G N, {F Ey } {2p) is 
a holomorphic Jacobi form of index n/2 and weight k + p over (2Z) 2 x T(N(m)). 
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Here N(m) is an integer depending on the level m and was given in [Kac], and 
defined in (1.6). 

Proof: Now, by (1.48), we get 

(1.49) mE vJ (ui + n v t) 2 - (s^) 2 + X 7li (4 + m 7 t) 2 ) = n ■ t 2 . 

This means 

, x mY, v nld(n v ) — E 7 m 2 (i(m 7 ) = n, mE vj n v ui = S 7J -m 7 x 7 , 

* ' ! mE^^E^ + E^) 2 . 

First by using (1.50), as in Lemma 1.1, for (a,b) G (2Z) 2 , we get 

(1.51) F E) v(t + ar + b,T)= e - mn ^ T+2at) F Ey {t, r). 

Second by a theorem of Kac, Peterson and Wakimoto [Kac, Chapter 13], there exists 
an integer N(m) such that for any g = ^ ° ^ ^ G T(iV(m)), we have 

(1.52) C E ,v(g(u + t, t)) = e ™^A<+n v tf/{cT+d) CE ^ u + t ^ T y 
Now, by using (1.21), (1.50) and (1.52), as Lemma 1.2, we get 

(1.53) F E , v (g(t, t)) = (cr + d) k e mnct2 ^ T+d ^ CT+d F Ey (t, r). 

As the same argument in the proof of Theorem 1.2 (see also [Liu4, Theorem 3.4]), 
we know F E y is holomorphic on C x H. By (1.51), (1.53), we get Theorem 1.3. ■ 

The following lemma was established in [EZ, Theorem 1.2]: 

Lemma 1.4 Let F be a holomorphic Jacobi form of index m and weight k. Then for 
fixed t, F(t, t), if not identically zero, has exactly 2m zeros in any fundamental domain 
for the action of the lattice on C. 

This tells us that there are no holomorphic Jacobi forms of negative index. Therefore, if 
m < 0, F must be identically zero. If m = 0, it is easy to see that F must be independent 
of t. So we immediately get the following: 

Corollary 1.1 Let M,B,V,E and n be as in Theorem 1.3. If n — 0, the equivariant 
Chern character of the index bundle of 



oo 

Ind(L> x (g) S qm (TX - dimX) <g> ip(E, V)) 



m=l 



is independent of g G S 1 . Ifn<0, this equivariant Chern character is identically zero, 
in particular, the Chern character of this index bundle is zero. 
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Family rigidity theorems for spm c -manifolds 



The purpose of this Section is to prove a family version of the rigidity theorem for 
spm c -manifolds. 

This Section is organized as follows: In Section 2.1, we explain the equivariant family 
index theorem for spm c -manifolds. In Section 2.2, we state our main result, Theorem 
2.2. In Section 2.3, we prove Theorem 2.2. In Section 2.4, we prove a family version 
of the rigidity and vanishing theorem for spin c -manifolds of [Dl]. A family vanishing 
theorem of Witten genus for sj9in c -manifolds is also obtained. 

2.1 Equivariant family index theorem for spm c -manifolds 

By [LM, Theorem 1.1], we have the equivariant family index theorem for a family of 
equivariant elliptic operators. In fact, by the proof of [LM], we know we have a local 
version of [LM, Theorem 1.1] for the Dirac operator associated to the Clifford module 
in the sense of [BeGeV, §3.3, §10.3]. 

Let 7r : M — > B be a fibration of compact manifolds with fiber X with dimX = 2k. 
We assume that the S* 1 acts fiberwisely on M, and TX has an S^-equivariant spin c 
structure. Let A(TX) be the complex spinor bundle for TX [LaM, Definition D.9]. We 
denote D c the corresponding spin c -Dirac operator on the fibre X [LaM, Appendix D]. 

Let W be an ^-equivariant complex vector bundle on M. Let D c <g> W be the twisted 
spin c -Dirac operator on A(TX) <g> W. Then lnd(D c ®W) e K 31(B). 

Let g = e 2ntt G S* 1 be a generator of the action group. Let {M a } be the fixed 
submanifolds of the circle action. Then 7r : M a — > B be a submersion with fibre X a . We 
have the following equivariant decomposition of TX 



Here iV 7 is a complex vector bundle such that g acts on it by e 27 ™ 71 ^. g Q TX a is naturally 
oriented. We denote the Chern roots of iV 7 by 2Tvixi 1 , and the Chern roots of TX a ®r C 
by {±27iiy'j}. Let dime N 7 = d(m y ), dimX a = 2k a . 

We recall that the spm c -structure on TX induces an S^-equivariant complex line 
bundle L over M. Its equivariant Chern class ci(L) s i will also be denoted by c 1 (TX) s i. 
We denote the Chern class c±(L) of L by 2 r nic\. Let i a : M a — > M be the inclusion, and 
let i* denote the induced homomorphism in equivariant cohomology. If g acts on L on 
M a by e 2wdct , we have 



We denote 7T* : H*(M 9 ) — > H*(B) the intergration along the fibre X 9 . Now, we can 
reformulate the family Atiyah-Bott-Segal-Singer Lefschetz fixed point formula, [LM, 
Theorem 1.1] in this case, 

Theorem 2.1 We have the following identity in H*(B) 



(2.1) 



TX [Ma = Aq • • • © N h TX, 



(2.2) 



Cd(TX) s i =2ni( Cl + l c t). 



(2.3) 



ch 9 (Ind(D c <g> W)) = ir* 



A(TX 9 )ch g (W)e 7vi( - Cl+l ^ 



n 



■7 



QKi{x 1 +m 1 t) g— ■Ki(x 1 +m 1 t) 
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2.2 Family rigidity for sj9in c -manifolds 

In this part, we use the assumption of Section 2.1, we also use the notation of Sections 
1 and 2.1. 

For a vector bundle E on M, we denote by E the reduced vector bundle E — dim(.E'). 

Let W be an S^-equivariant complex vector bundle of rank r over M. Let L w = 
det(W) the determinant line bundle of W on M. Let V be a dimension 21 real vector 
bundle on M with S^-equivariant spin(2l) structure. Let A(V) = A + (V) © A~(V) be 
the spinor bundle of V. 

Let y = e 2nt/3 be a complex number, and we define the following elements in K(M) [[q 1 ^ 2 ]] '■ 

oo oo 

G q (TX\W) v = (g) S q m(TX) <g> A_i(W) <g> (g) A_ 9n (ir®Tc), 

(2.4) m = x _ _ _ 

eJ(TX|PF), = (g) S^TX) ® A_„-i(W*) ® (g) A- OT n(PF) ® A_,- V (W*). 

m=l n=l 

Let 

i2i(y)„ = A(y)<g)(g)^ =1 v(i/), 

(2.5) i?2(^), = (8)r=iA_ ? n-^), 

For 5 = e 2wit , te~R,q = e 2wir , r G H, set 

Fi(i, r) = 2- i ch^Ind( J D c ® e ? (TX|W), ® i?i(V),)), 
(2 ' 6) Ff(t,r) = 2^ch s (lnd( J D c ®e^(TX|PF), ) ® J R 1 (\/), ) )). 

We consider Fi(t,r), F-[(t,r) as functions on (t, r) G C x H with values in H*(B). 
Recall that for n G N*, 

(2.7) ri (n) = {(/ = ( £ ^)gSL 2 (Z)|^(J *)(modn)}. 



Theorem 2.2 If p^V + W - TX) s i = n ■ if*u 2 (n G Z), Ci(W) s i = ci(TX) s i in 
H* S1 (M,Z) ® z Q. T/ien 

i) . 7/ci(W) = mod(JV) (N eN,N > 1), then for y = e 2ni/3 an Nth root of unity, 
andpe N, {Ff(t, r)}^ is a holomorphic Jacobi form of index n/2 and weight (k + p) 
over (2NZ) 2 x F^N). 

ii) . For p G N 7 {Fi(t, r)Y 2p Hs a holomorphic Jacobi form of index n/2 and weight 
k-r+p over (2Z) 2 x r\(2). IfV = 0, the same holds for r x (2) replaced by SL 2 (Z). 

Remark: If we replace the condition c 1 (W) s i = c 1 (TX) s i by uo 2 (TX) = u 2 (W). 
Let Fi(t,r), and let Ff(t,r) be the equivariant Chern character of index bundles of 
^ c ®(L w ®L- 1 )V 2 ®0 g (TX|PF),®i? 1 (y),,D c ©(L VK ®L- 1 ) 1 / 2 ®e^(TX|lF)^i? 1 (V) t) , 
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we still have Theorem 2.2. In fact, we only need to take tensor product of (Lw ® L -1 ) 1 / 2 
with the corresponding operators in the proof of Theorem 2.2. If V — 0, this result also 
generalizes [Liu2, Theorem B] to the family case. 

Remark: If we replace the condition ci(W) s i = Ci(TX) s i by Ci(W) = C\(TX) in 
H*(M, Q), as Dessai remarked in [D, Lemma 3.4], then there exists m e Z such that 
Ci(W) s i - d(TX) s i = mT*u. Now, for the functions e^ mt F x {t, r), e™ m *Ff(t, r), we still 
have the result of Theorem 2.2. In fact this only multiplies all the functions in the proof 
of Theorem 2.2 by e™ mt . 



2.3 Proof of Theorem 2.2 

Let 

(2.8) V\ Ma ^V l ®---®V h , 

be the equivariant decomposition of V restricted to M a . Assume that g acts on V v by 
e 27rm "*, where some n v may be zero. We denote the Chern roots of V v by 2mu{. Write 
dim R V v = 2d(n v ). Similarly, let 

(2.9) W]Ma = W 1 (B---(BW ro , 

be the equivariant decomposition of W restricted to M a . Assume that g acts on by 
e 2vnr M ^ w ]j ere some r M may be zero. We denote the Chern roots of by 2-kiuj^. Write 
dim c Wf,, = d{r^). 

First note that the condition ci(W) s i = c\(TX) s i means that 

(2.10) s w -(uj + v) = Cl + l c t. 

We take (3 = 1/JV. By applying the family Atiyah-Bott-Segal-Singer Lefschetz fixed 
point formula, Theorem 2.1, and using (2.10), for g = e 2mt ,t e R \ Q, we get 

^'(O.t)*-^ r/ 2my' 



(2.11) 



-n^(w M + r M t + /3, r)(W^) 



Tl 1 6(x 1 + rrijt, t)(N^j 

In the following, we will consider Fi(t,r), F^(t,r) as meromorphic functions on 
(f, r) e C x H with values in H* (B). 

Lemma 2.1 If pi(V + W - TX) s i = n ■ W*(u 2 ) in Hg 1 (M, Z) ® z Q for some integer n, 

i) For a,be 2Z, 

(2.12) Fi(t + ar + b, r) = e -™(« 2 -+2«t) Fl ( t) r ). 

ii) For a,be 2NZ, 

(2.13) F?(t + ar + b,r)= e -™(« 2 -+2«t) F /3( t) r ). 
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Proof: Since pi(V + W — TX) s i = n ■ ti*u 2 , we have 

(2.14) KA4 + nvtf + + V) 2 - (£^) 2 + S 7J (4 + m 7 t) 2 ) = nt 2 . 
This implies the equalities: 

(2.15) Y, vJ n v ul + E^uj^r^ = £ 7ii m 7 a; 7 , 
S„n 2 rf(n 1) ) + S M r 2 rf(r M ) - S 7 m 2 rf(m 7 ) = n. 

By (1.15), for 0„ = 0, l5 a, b G 2Z, Z G Z, we have 

(2.16) 0„(a; + Z(* + ar + b), r) = e -*iWa*+v?<*+P" 2 T)Q v ( x + ^ r ). 

Let Fi, a , F^ Q be the contribution of M a to Fi(i, r), Ff (t, r). By using (2.11), (2.15), 
(2.16), we get for a,b G 2Z, 

F liQ (t + ar + 6,r) = e"™ ^ +2a ')F M (i, r), 

1 • > F( a (t + OT + 6, r) = y -S M r M a e -7rm(a 2 r+2at) F ^(^ T y 

Since by the assumption, y N = 1, we get Lemma 2.1. ■ 
For A = 



5 \ 

^ j G SX 2 (Z), we define 



1, if (c,d) = (0,l) (mod2), 
(2.18) £a=<( 2, if (c,d) = (l,0) (mod2), 

3, if (c,d) = (1,1) (mod2) 

For g = e 2nit , t G R, A = ^ " ^ G SX 2 (Z), j = 1, 2, 3, we let 

F,(t, r) = e(j)ch fl (lnd(L> c ® 6,(TX|W0„ ® 
(2 ' 19) Ff (f, r)^ 4 = e(j)ch 9 (lnd( J D c ® L$ ® ef +d)/3 (TX|^)„ ® F,(y)„)). 

with e(j) = 2~' for j = 1; 1 for j = 2, 3. 

By applying the family Atiyah-Bott-Segal-Singer Lefschetz fixed point formula, The- 
orem 2.1, and using (2.10), for g = e 2nit , t G R \ Q, j = 1, 2, 3, we get 

_ k 9'(0,r) k - r ^ r/ 2my' 



(2.20) 



ll 7 0(:r 7 + m 7 t, r)(iV 7 ) 



n^K + V,r)(W^) 



Remark: In fact, to define a S^-action on L^, we must replace the S l - action by 
its iV-fold action. Here by abusing notation, we still say an S^-action without causing 
any confusion. 
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Lemma 2.2 If pi(V + W — TX) s i = n • ir*(u 2 ), under the action A = ^ ° ^ ^ 
SX 2 (Z), we /iawe 



(2.21) 



Fi(A(t, r)) = (cr + d) fe - r e™ rf2 /( CT+ ^ CT+(i F £A (t, r), 
if (A(t, r)) = (cr + d) k e M2 /^+i)m cT+dF P (t, r) A , 



Proof: As the equation for F 1 in (2.21) is very easy, we leave it to the interested 
reader. Here, we only prove (2.21) for Fj 8 . 

By (1.15), (1.16), is a Jacobi form of index 1/2 and weight over (2Z) 2 xTi(2). 

This explains the index e A in the following equation. By (1.16), we get 



cr+d' 



(2.22) 



t ar+b \ 
cr+d' 1 cr+d 1 

t CLT+b \ 
cr+d 1 CT+dl 



(cr + d)e m zr+d 



ar±b\ 



m CT+d> 

n l t ar+b \ 
Ul \cr+d' CT+d> 



= e 



9(t,r)> 

nH ^-.-picr+d)) d ( t ^ T ) 



0(P(cr + d),TY 



7TIC r- 7 

g cT + a 



By (2.11), (2.22), we get 
t ar + b. 



F( 



01 



'cr + d cr 

ru 



d' 



(2m) 



a 



7U 



ar+b\ 



6'(0, 
2my' 1 ' CT+d ' 



6(y' ^±6 



cr+d) 



f Xsy | 77?"^ 



(JV 7 )n„ 

(2.23) WffJ) ^ 

= (27T2)- fe (cr + d)* e «^/(«-+«0 ^ ^ J^ttV 



cr+d ' 

9i(u v H 



(TX 9 ) 



n,, 



cr+d' ct+o!' 



0l(O,2I±6' 



(K) 



0'(O,r) 



-)(TX* 



n 7 ( 



n, 



#((cr + d)x 1 + m 7 t, r) 



(iv 7 )n„ 



6((ct + %' 

£a ((ct + d)u v + n„£,r) 



^(0,r) 



(K) 



To prove (2.23), we will prove 

27ciy' 
9((cT + d)y ; ,r) 



(TX 6 



e((cr + d)(3,r) 

U v 8 £a ((ct + d)u v + n v t,r)(V v ) 
H y 9((cT + d)x 1 + rrijt, r)(iV 7 ) 



TO 



(2.24) 



n, 



(2p) 



ILA A (u„ + n v t,r)(V v ) 



6(y> 



1 6(x 1 + m 7 t, r)(iV 7 ) 



n, 



^^(^ + V + (cr + rf)/3,r)](^) 



(2p) 



By looking at the degree 2(p + k a ) part, that is the (p + fc Q )-th homogeneous terms of 
the polynomials in x's, y"s, u's and u;'s on both sides, we immediately get (2.24). 
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The proof of Lemma 2.2 is complete. ■ 

Since Fj(t,r), F^(t,r) A (j = 1,2,3) are the equivariant Chern characters of the 
index bundles of some elliptic operators, the same proof as that of Lemma 1.3 gives the 
following 

Lemma 2.3 i) Fj(t,r) (j = 1,2,3) is holomorphic in (t, r) G R x H. 

ii) Ifc^W) = 0(modiV) ; then for A G SL 2 (Z), j = 1,2,3, F^{t,r) A is holomorphic 
in (t,r) G R x H. 

This is the only essential place where we need the topological condition Ci(W) = 
O(modiV) which insures the existence of L^>, therefore the holomorphicity of F^(t,r) A 
for t G R. 

Proof of Theorem 2.2: Now, if A = ^ ^ G T^N), by (1.15), (2.20), we get 

(2.25) Ff A {t,r) A = Ff(t,r). 

By using the above three Lemmas, and proceeding as in the proof of Theorem 1.1, 
we know that F-f (t, r) is holomorphic in (t, r) G C x H. 

/,From Lemmas 2.1, 2.2, (2.25), we get Theorem 2.2. ■ 



2.4 Family rigidity and vanishing theorems for spm c -manifolds 

From Lemma 1.4 and Theorem 2.2, we get the following family rigidity and vanishing 
theorems for spin c -manifolds. 

Theorem 2.3 Let M,B,W,V as in Theorem 2.2. If p^V + W - TX) s i = n ■ W*u 2 
(n G Z) and d(W) S i = c 1 (TX) s i in H* S1 (M, Z) ® z Q- 

%). If n = 0, then D c ® Q q (TX\W) v ® Ri(V) v is rigid. If, in addition, Ci(W) is 
divisible by an integer N > 2, then D c <8> Q^{TX\W) V <S> R\(V) V is rigid for y = e 2mf3 an 
Nth root of unity. 

ii). If n < 0, then the equivariant Chern character of the index bundle D c <S> 
Q q (TX\W) v <8>Ri(V) v vanishes identically, in particular, the Chern character of this 
index bundle is zero. If, in addition, c\{W) is divisible by an integer N > 2, then the 
equivariant Chern character of the index bundle D c <g> Q^(TX\W) V <8> R 1 (V) V vanishes 
identically for y = e 2ml3 an Nth root of unity, in particular, the Chern character of this 
index bundle is zero. 

The following family vanishing Theorem generalizes [LM, Theorem 3.2] to family 
spm c -manifolds. 

Theorem 2.4 Let ir : M — > B be a fibration of compact connected manifolds with 
compact fibre X, and S 1 acts fiberwisely and non-trivially on M. We suppose TX has a 
S 1 - equivariant spin structure. Ifc\{TX) = in H*(M,Q), and if pi(TX) s i = —n-T*u 2 
in ifgi(M, Z)®zQ for some integer n, then the equivariant Chern character of the index 
bundle, especially the Chern character of the index bundle of D c ®®^ =1 S q m(TX) is zero. 
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Remark: Note that the condition c±(TX) = in H*(M, Q) does not mean the Spin 
structure is spin. This only insures that there exists m G Z, such that c\(TX) s i = mW*u. 
So in fact, the difference between [LM, Theorem 3.2] and Theorem 2.4 are quite subtle. 

As pointed out by Dessai [D2, §3], when the ^-action is induced from an S* 3 or nice 
Pin(2) action on M (In fact the S 3 and Pin(2) action need not act fiberwisely on M), 
the condition pi (TX) s i = —n ■ Jf*u 2 in H s i (M, Z) ® z Q is also equivalent to p\ (TX) = 
in H*(M,Q). 

In [HL] , some related result was proved for foliations. 

Proof of Theorem 2.4'- We only need to put W = V = in Theorem 2.2. In fact, by 
(2.15), we know 

(2.26) Tjjm^dirrij) = —n. 

So the case n > can never happen. If n = 0, then all the exponents {rrij} are zero, so 
the S^-action can not have a fixed point. By (2.11), we get the result. For n < 0, by 
Remark in Section 2.2 and Theorem 2.3, we get the result. ■ 
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